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1. Introduction 

Kostka-Folkes polynomials may be considered as coefficients of the formal 
power series representing the character of certain graded GL(n)-modules. 
These GL(n)-modules are defined by twisting the coordinate ring of the 
nullcone by a suitable line bundle and the definition may be generalized 
by twisting the coordinate ring of any nilpotent conjugacy closure in gl{n) 
by a suitable vector bundle ||l^. The resulting polynomials have been called 
generalized Kostka polynomials. 

Jing defined a vertex operator that generates the Hall-Littlewood sym- 
metric function g] thereby giving an elegant symmetric function re- 
cursion for the Kostka-Foulkes polynomials. Garsia used a variant of Jing's 
vertex operator to derive various new formulas for the Kostka-Foulkes poly- 
nomials. 

Our point of departure was the observation that the Hall-Littlewood ver- 
tex operators can be used to obtain formulas for generalized Kostka poly- 
nomials. Our treatment uses Garsia's plethystic type formulas. 

One striking fact is that the Z[g, g~^]-linear span of n-fold compositions 
of components of the Hall-Littlewood vertex operators, is isomorphic to 
-f^GxC* (A/"), the GL{n) x C*-equivariant i^-theory of the nullcone. Under 
this isomorphism, an n-fold composite operator is sent to the class of the 
Euler characteristic of a twisted module. This fact has a generalization for 
all the nilpotent conjugacy class closures in gl{n). 

These Grothendieck groups were studied in We derive many explicit 
relations among the vertex operators, most of which can be in interpreted as 
relations in the Grothendieck groups which arise from certain Koszul com- 
plexes. This allows for more explicit proofs of some basis theorems for these 
Grothendieck groups that were proved in Q using geometric arguments. 

There is a particularly well-behaved subfamily of the generalized Kostka 
polynomials, namely, those that are indexed by a sequence of rectangular 
partitions. For this subfamily almost all of the formulas for Kostka-Foulkes 
polynomials have generalizations. There are combinatorial formulas involv- 
ing Littlewood- Richardson tableaux [^] |1C , rigged configurations and 
inhomogeneous paths with energy function [1^1 ITT 
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2. HOPF ALGEBRA OF SYMMETRIC FUNCTIONS AND PLETHYSM 



This section contains standard background material on symmetric func- 
tions which can be found in Q. The possible exception to this is the defini- 
tion of the plethystic notation used here. 

Let A = Ap be the algebra of symmetric functions over a field F of char- 
acteristic zero. A may be defined as the polynomial algebra ¥[pi,p2, ■ ■ ■] 
where the pk are commuting algebraically independent variables. Let V be 
the set of partitions. For A = (Ai,...,Afc) G V, write |A| = Yli=i^i ^^'^ 
let p\ = • • • PXk denote the power symmetric function. Declaring to 
have degree k, A is endowed with a grading A = ®„>o A" where A" is the 
homogeneous component of degree n. A" has F-basis {px | A € |A| = n}. 

A may be realized by symmetric series. Let X = {xi,X2, . . . ) be a count- 
able set of commuting indeterminates. Denote by F[[X]] the F-algebra of 
formal power series in the Xi where each Xi has degree 1, and F{,[[X]] C F[[X]] 
the subalgebra consisting of series whose monomials are of bounded degree. 
Let A'''- C Fb[[X]] denote the F-subalgebra consisting of the series that are 
symmetric in the variables Xi. By the universal mapping property of a 
polynomial algebra, there is a F-algebra homomorphism A — s- A^ given by 
Pk Xi + X2 + ■ ■ ■ ■ This map is in fact a graded F-algebra isomorphism. 

There is a scalar product on A for which the power symmetric functions 
are an orthogonal basis: 

(pa, Pm) = ^Am^a 

where is the Kronecker delta, z\ = Yl^ni{X)l^'^^^^\ and nj(A) is the 
number of parts of size i in the partition A. 

We now define notation for plethystic substitution. 

Let g G F be a distinguished element that is transcendental over Q. Fix an 
element E G F{,[[X]]. Define Pfc[-E'] G F;,[[X]] to be the series obtained from 
E by replacing q by and xi by x^ for alH > 1. By the universal mapping 
property of a polynomial algebra, there is a unique F-algebra homomorphism 
A ¥b[[X]] such that pk Pk[E]- The image of P G A under this map is 
denoted P[E]. 

Switching viewpoints and considering pk[E] for various E, we see di- 
rectly from the definitions that E 1-^ is a Q-algebra homomorphism 
¥h[[X]] ^ ¥h[[X]] and A^ ^ A^ given by Pk[E ± E'] = pk[E] ± pk[E'] 
and Pk[EE'] = pk[E]pk[E'] for all E,E' G ¥f,[[X]]. It is not an F-algebra 
homomorphism since it changes the scalar qio q^ . 

By abuse of notation the variable X will also be used to represent the 
formal sum xi + X2 + x^, + ■ ■ ■ ■ By definition 

Pk[X]=pk[xi+X2 + x-i + ---]=x\ + x'l^+xl + -- - . 
Example 1. 62 = — G A. For the expression E = xi+X2^e have 

e2[xi + X2] = {X\ + X2)^/2 - {x\ + X2)/2 = X\X2 
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lfE= then Pi[j^] = and fiij^] = j^, so that 
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Recah that each E € F5[[X]] defines an F-algebra homomorphism A — > 
Fb[[X]] such that P 

1. If £^ = X then P H- > P[X] yields the above isomorphism A = A^. 

2. If £^ = then the F-algcbra homomorphism e : A — > F given by 
P I— > P[0] is the counit for A; it selects the constant term. 

3. li E = xi + X2 + ■ ■ ■ + Xm then P P[xi + X2 + ■ ■ ■ + Xm] is the 
F-algebra epimorphism A — > ¥[xi, . . . jXru]^"" onto the F-algebra of 
symmetric polynomials in xi through Xm where Sm is the symmetric 
group on m letters. 

4. If E = X/{q-l) then the map P[X] ^ P[X/{q-l)] is an F-algebra iso- 
morphism A ^ A with inverse map P[X] P[X(q — 1)]. In particular 
if {fx} is a basis of A then so are {f\[X{q — 1)]} and {fx[X/{q — 1)]}. 

We now discuss the Hopf algebra structure on A. Let Y = yi + y2 + ■ ■ ■ 
where the yi are another countable set of commuting indeterminates. Let 
A"^'^ denote the F-subalgebra of F^ffX, y]] consisting of the series that are 
symmetric in both the Xi and the yj. Then there is an isomorphism Ai^pA 
j^X;Y g-^gj^ by y (gi ^ /[X]5f[y] for f,g e A. Letting = X -|- y, the map 
P P[X -|- y] defines an F-algebra homomorphism A : A — ^ A (g) A. A is 
the comultiplication map for A. The maps A and e give A the structure of 
a coassociative cocommutative Hopf algebra. 

There is a scalar product on A A defined by 

{fi[X]gi[Y], MX]g2[Y])j,x^^Y = (/i, /2)(5i, 52) 

for all fi,gi G A for i = 1,2 and this relation is then extended by linearity. 
With respect to this scalar product on A (gi A, the map A is adjoint to the 
multiplication map A A — *■ A given hy f ^ g ^ fg. That is, 

(1) {f,gh) = {f[X + Y],g[X]h[Y]) 

for all f,g,h^ A. 

To deal with the Cauchy kernel it is necessary to work in a completion of 
A. Let A = F[[pi,p2, ■■■]], the F-algebra of formal power series in thepj. The 
symmetric realization A'''" of A is given by the F-subalgebra of symmetric 
series in F[[A"]]. Given any element E G F5[[Ar]] with no constant term and 
P G A, the plethysm P[E] G F[[X]] may be defined by substitution as before. 

Define the Cauchy kernel J7 G A by 

Q = exp j ""y^^Prh 

\r>l 
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The following formulas are consequences of the definitions: 
n[-zX] =l[l-zx, = ^(-z)'=efc[X] 

i k>0 

n[x + Y] = n[x]n[Y] 

n[x -Y] = n[x]n[-Y] = n[x]/n[Y] 

n[XY] = Y,-^x[X]sx[Y] 

where hk, e^, and sx are the homogeneous, elementary, and Schur symmetric 
functions respectively. 

Two bases {a\} and {6a} of A are dual with respect to the scalar product 
if and only if ZxeP ax[X]bx[Y] = n[XY]. 

For / G A, let /"*" be the linear operator on A that is adjoint to multipli- 
cation by / with respect to the scalar product: 

(2) {f^ig),h) = {g,fh) 

for all g,h A. This operator is usually referred to as "f-perp" or "skewing 
by f." 

The skewing operators and the map A (or equivalently the plethystic map 
P 1-^ P[X + y]) can be expressed in terms of each other. For any /, g, /i E A, 

(3) {f^{g),h) = {g[X + Y],f[Y]h[X]) 

using (^), ([l|), and the commutativity of multiplication in A. Let {ax} and 
{6a} be dual bases of A. Then for every P G A, 

(4) P[X + Y]=Y,ibiiP))[X]ax[Y]. 

A 

3. Definition of the operator 

Using plethystic substitution we define a family of linear operators on 
symmetric functions. Define the formal Laurent series H{Z^) in an ordered 
set of variables = {zi, Z2, ■ ■ ■ , Zf^) with coefficients given by operators on 
A, which acts on P E A by 

(5) H{Z^)P[X] = P[X - (1 - q)Z*]n[ZX]R{Z^) 

where Z* = ^f^^ ^r^, Z = ^f^^ Zi and R{Z'') = ni<i<i<fc 1 - ^jhi- For 
v G Z*"', define the operator Hy by 

(6) H^P[X] = H{Z'')P[X] 

Remark 2. 1. If /c = 1 this is Garsia's |^] |^] version of Jing's Hall- 
Littlewood vertex operator Q. 



2. At q = this formula reduces to plethystic notation for a repeated 
application of the Schur function vertex operator that is due to Bern- 
stein I, p.96, # 29 (d)], |]. So H^^^^^H^^^y ■ H^^^^ = for any 

V € Z*^. If f is a partition A = (Ai, . . . , Aj^) with at most k parts then 
Hll = sx[X]. 

3. When ^ = 1 and A is a partition, this formula reduces to multiplication 
by the Schur function sx: Q.[ZX]R{Z'') = sx[X]. 

4. H'^ 1 = s\ for any partition A = (Ai, . . . , Afc) with at most k parts. If 
Ufc < then 1 = 0. 

This operator possesses the same shifted skew symmetry in its subscript 
that Schur functions have. Let Z> denote the set of dominant integral 
weights in Z'^, that is, the weakly decreasing sequences in Z*'. Let C Z> 
be the set of partitions of length at most k, which are always regarded as 
having k parts, some of which may be zero. 

Proposition 3. Let t> € Z'^. Then 

~ ^{vi,V2...,Vi+l-l,Vi + l,...,Vk)' 

In particular i/vj+i = Vi + 1 then = 0. 

Proof. Let SiZ^ be the sequence Z'^ with Zi and Zj+i exchanged. Then 
H(siZ^) = ^f^^^^HiZ^) = — ^HiZ^). The result follows by taking 
the coefficient of z'" on both sides of this equation. If Wj+i = Vi + 1 then 
Hy = —Hy and hence must be zero. □ 

The following corollary shows that for every v (zli^ , Hy is either zero or 
up to sign equal to for some v G Z>. 

Corollary 4. Let u E Z'^, a G Sk, and p = p^^^ = {k - l,k - 2, . . . ,0). 

Then 

(7) H^. = s^gn{a)Hl^^^^y. 

In particular, ifv + p has two equal parts then Hi, = 0. Otherwise there is a 
unique a € such that a{v + p) is strictly decreasing, so that a{v + p) — p 
Z|. 

4. Another formula for the vertex operator 

We derive another formula for the operator Hu, which will be used to 
prove a strong linear independence property of the operators. To do this, it 
is convenient to introduce some notation for the irreducible rational charac- 
ters of GL{k). The polynomial representation ring of GL{k) is isomorphic to 
the F-algebra F[zi, 2:27 • • • , Zk]^'' of symmetric polynomials in the variables Zi. 
The rational representation ring R{GL{k)) is isomorphic to the F-algebra of 
symmetric Laurent polynomials in the variables zi, 2:2, . . . ,Zk or equivalently 



the localization ¥[zi, . . . '=[det[Z]^^] of the algebra of symmetric poly- 
nomials obtained by inverting the character det[Z] = ziZ2 ■ ■ ■ zi^ of the deter- 
minant module. R{GL{k)) has a distinguished basis {sa[-^] I ^ ^>} where 
s\[Z] is the character of the irreducible finite-dimensional GL(n)-module V'^ 
of highest weight A. Explicitly, if m is an integer such that m > —X^ then 
s\[Z] = det[Z]"™s;,_^(„fc)[Z] where = {m,m, . . . ,m) G Z^, A + (m^) is 
the vector sum in Z'^ (which is a partition) and sx+(m'')[^] is the Schur poly- 
nomial. For V € Z'^, define its dual weight v* = {—Vk, —v^-i, . . . , —vi). If 
A € Z> then so is A*; it satisfies {V'^)* = F'^* where V* is the contragredient 
dual of V. 

Denote by c^^ the tensor product multiplicities: 

s,[Z]s,[Z] = c'^u^xiZ] 

for X, fijU € Z>. It is well-known that 

(8) c^^ = dim(y^* (8) y^)GL(«) 

where V'^ denotes the submodule of V fixed by G. Moreover for any finite- 
dimensional G-module, 

(9) dim((y*)^) = dim(F^). 
Let 

(10) H{Z)P[X]=P[X -{l-q)Z*]n[ZX]. 
Then by (|) and @, 

(11) HiZ) = s,[Z]Hl. 
Proposition 5. For v € 

(12) iii= c>AmsM[^('?-i)]^- 

Proof. Let Y be another set of variables and let H{Z) act on the X variables. 
We have 

H{Z)n[XY] = n[XY]Q[{q - l)Z*Y]n[XZ] 

= n[XY]Y E ^AZW,*xS^[{q-msx[X]. 
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The tensor product multiplicity can be rewritten using (^) and (P) so that 
^/i*A ~ ^'fliy- Clearly we have for fixed 7 G 'P'^ and u E Z> 



H^s-y[X] = H{Z)n[XY] 



E c^^,Sx[X]s,[{q-l)X]^s^[X] 



It is seen that (12) holds on the Schur basis and hence on A. □ 



5. Linear independence 

The full strength of the following result is required later, when we work 
with operators on A that are infinite linear combinations of the H^- 

Proposition 6. Let {cy € F | 1/ € Z>, \v\ = d] he an arbitrary collection 
of scalars. Then the map F = 'Yliue'L*' \v\=d'^^^i' ^ well-defined linear 
operator on A. Moreover this operator is if and only if Cu = for all 
u E Z> with \u\ = d. 

Proof. Any infinite linear combination of operators of the form sx [X]s^ [X{q— 
1)]-*- with |A| = \ix\ +d is well-defined because its action on any given element 
of the basis {s\[X/[q — 1)]} has only finitely many nonzero summands. 

The operator F = X^^g^fc \j^\^^^CyH'i is well-defined because for fixed par- 
titions A and ^, s\[X]s^[X{q — 1)]^ appears in the formula given in Propo- 
sition m for only finitely many Hi, namely for those such that c^^, 7^ 0. 

For 7 G Z^, set 0(7) G to be the partition with 0(7)^ = max(7j,0) 
and /3(7) G be the partition defined by /3(7)i = — min(7fc+i_j, 0). 

By Proposition |5|, for r G , 

(13) H'^{sr[X/{q-l)])= E c';.,s>.[X]s,[X{q-l)]^{s,[X/{q-l)]). 

The Littlewood Richardson rule implies that the coefficient c^^ = unless 
A' 3 f^{l)- Since {s^[X{q — 1)]} and {sT-[X/{q — 1)]} are dual bases, we 
calculate that H3,{sr[X/{q - 1)]) = if |r| < |/3(7)| and r 7^ /3(7), and 
i/^(.^(^)[X/(g-l)]) = s,(^)[X]. 

It follows now that F = if and only if = for all 7. For if all of the 
coefficients are not zero, then 7 is chosen such that is non-zero and |/3(7)| 
is a minimum. We see then that 

(14) Fisp^^)[X/iq -!)])= E c,SaHW/0 

/3(!^)=/3(7) 

□ 



6. Connection with generalized Kostka polynomials 

Next it is shown that the operators have the same relation to the gen- 
erahzed Kostka polynomials of [^] that the components of Garsia's modified 
Hall-Littlewood vertex operator has to the Kostka-Foulkes polynomials. 

Let us recall the definition of the generalized Kostka polynomials. Let 
7/ = (r/i, 7^2, . . . , ^t) be a sequence of positive integers summing to n. Let 

Roots^ = \ I < i < i]! + • ■ ■ + r]k < j < n for some k } 

be the set of strictly upper block triangular positions in an n x n matrix 
with diagonal block sizes given by r/. Let Z be the sequence of variables zi 
through Zn- Define the formal power series Brj[Z;q] by 

{j,j)GRoots^ V J 

Let J be the antisymmetrizer J = X^^-g^ sigii{a)a. Define the linear oper- 
ator TT : ¥[zf, . . . , z±] ^ R{GL{n)) given\y 7r(/) = J {zP)-^ J {zP f) . 
Let 7 G Z"". Define the generating series 

n^^^[Z-q]=n{z^B^[Z-q]). 

Since | A G Z"} is a basis of R{GL{n)), define K\^^{q) G ^[[(7]] by 

n^,-,[Z-q] = sx[Z]Kxrn{q)- 

It is shown in that Kx^riil) G ^[q]- 

By developing the product of geometric series in Brj[Z;q] and using the 
shifted skew symmetry of the index for irreducible characters 

Sv[Z] = sign(cr)s^(„+p)_p[Z] 

for v G and a € Sn, one obtains the following expression [13|: 



(15) Kx^^iq) = sign(cr) 



E 

a£Sn m:Roots^— >N 

wt{m)=(7(A+p) — (7+p) 



where ei through e-n is the standard basis of Z", \m\ — X/(i,j)GRoots, 
and wt(m) = E(»j)GRoots, " ^j)- 

Given rj and 7, write 7 = {j^^\"y^'^\ ■ ■ ■ ,7^*-') with 7^*^ G Z^' and assume 
that 7^*) G Z;?:. 

Proposition 7. 

(16) ^^D^^^) • • • ^;.) = E Kx,,,,{q)Hl. 

Proof. Let Z^ be the entire set of n variables zi through z„. Break this 
set into t collections of successive variables such that the i-th collection 
has size rji for 1 < i < t. We have the relation H{U^)H{V^) = 



Q[qU*V]H{U^ ,V^), which is verified by showing it holds when evaluated 
on an arbitrary P € A: 

H{U'')H{V^)P[X] = P[X - (1 - q){U* + v*)]n[ux] 

n[V{X - (1 - q)U*)]R{U^)R{V^) 

= P[X - (1 - q){U* + V*)]Q[{U + V)X] 

n[qU*V]RiU\V^) 

It follows that 

(17) i?(z«)i?(z(2))...if(zW) = //(z'^) Yl ^[q{z^'^T z^^^] 

^<i<j<t 

Observe that H'^^y^H'^^^) ' ' ' ^j(t) is the coefficient of on the left hand side 
of ([T7|). The coefficient of z"' on the right hand side is ^''"'-^7+wt(m) 
where m runs over the functions m : Roots,, N. By Proposition ^ the 
operators H'j^ are independent for A G . Hence we may take the coefficient 
of H'^ on both sides. Using Corollary |^ the right hand side becomes precisely 
the the expression (|l5|) of Kxyq{q)- □ 

If 7 is such that 7'-*^ G V^^, define the symmetric function 

(18) 'H{^W,...,jM)[X;q] = if;^(i)i7^(2) ■■■H'^(t) 1- 
Then 

(19) n^yW,...,^W)[X;q]= Kxj^{q)sx[X] 



which is a finite sum, unlike the expansion (16) which is an infinite sum. At 



q = I this is the expansion of the product of Schur functions s^(i) ■ • • s^(t) in 
the Schur basis. 

We have shown that the coefficients of the expansions of EI,j^^[Z;g] in 
terms of irreducible characters, and -ff^(i) • • • -f^^(t) ™ terms of the H'^ for 
Z" , are the same. Consequently, at least on the level of characters, the 
questions of 0] regarding a certain Grothendieck ring of graded modules, 
can be translated into questions regarding the span of the above operators. 

7. Spaces of vertex operators and commutation relations 

By manipulating the order of the variables we may derive several sorts of 
explicit commutation relations. These are applied to prove basis theorems 
for spaces of our operators. Let Q{k,n) denote the Z[g]-span of operators of 
the form Hf^Hl where \jl dl)^ and v E Z", and G>{k, n) the Z[(7]-span of such 
operators with the concatenated weight dominant, that is, (/i,i^) € Z^"^". 

The following are vertex operator analogues of results proven in |^ for 
Grothendieck groups. Our proofs have the advantage of being explicit and 
working over Z[g] instead of Z[(7, q~^]. Moreover our relations among vertex 
operators can be lifted to relations in the Grothendieck groups. 
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Theorem 8. Q{k,n) = G>{k,n). 



Theorem 9. If k > n then Q{k,n) <Z Q{k — l,n + 1) and G{n, k) <Z G{n + 

Theorem 10. Q{k,n) = Q{n,k). 

Consider the following generating function equation that follows easily 
from manipulating the operators on an arbitrary symmetric function. 

(20) 

/^(c/^ v^)H{w'^z'')n[-q{u*w + v*w + v*z)] 

m I 

= H{U\ W"')H{V^, Z'')n[-q{U*V + W*V + W*Z)]{-lY"^ w^^ J| y- 

i=l i=l 

Setting ^ = m = 1 in this formula gives enough relations to prove Theorem 
^. For brevity of notation, define |^ = |q:| — \(3\. If /u, E Z" then we will 
say that i//^ is a vertical strip, and denote this by i^/^u G V, provided that 

— /ii G {0, 1} for all 1 < i < n. 

Lemma 11. For all a, 6 S Z and € and v G , 



(21) 



(a,a+|-)^^(b-|-,/3) y--(a,a+|-+l)^^(b-|--l,/3)^ 



Proof. From equation (pOD, 

H{U^,v)H{w, Z")Jl[-g(C/*u; + v*w + v* Z)] 
= H{U^,w)H{v, Z")Jl[-g(C/*v + w*v + w*Z)]{-w/v) 

The desired identity is obtained by taking the coefficient of u^v°"ufi z'^ . □ 

Note that if 6 = a + 1, then (^) reduces significantly to the following 
identity. 

2^ 2^ { ^(a,a+|p^(a+l-|-,/3) 
a/fj.eV u/l3eV 

(22) = E E 

Relations (21) and (^) suffice to prove Theorem ^. Before giving the 
proof an example is helpful. 
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Example 12. We wish to show that H'^22)^{'ii) ^ hnear combination of 
HaH'p with a, /9 G such that (a, (3) is dominant. 

-"(22)-" (41) y-"(23)-"(40) y-"(32)-"(31) y -"(33)-"(30) 

_ nZTl Ul _|_ r,2 Cf? I «2 rrg rj? _ „3 Tjq rrq _ 

y-"(23)-"(31) -"(24) -"(30) -"(33)-" (21) ^ -"(34) -"(20) ~ 

„ 0-9 fj? _ „2 Tj-g 7:79 _ „2 Tjg rrg , „3 rrq rrq 
y-"(24)-"(21) y -"(25)-"(20) y -"(34)-"(ll) ^ y -"(35)-"(10) 

-"(23)-"(31) ^ y-"(24)-"(30) y-"(33)-"(21) ^ -"(34)-"(20) 

By CoroUary ^ many terms vanish and others cancel with each other. 
The terms F(^23)^('40)' ^{23)^h^V ^m^{2oy ^""^ ^m^lii) 
The terms H'^^i)^'^^,^'^ and H^^^^H'^^^^s^ cancel and so do qH'^24)^'121) ^^'^ 
qn'^^^^H^^^y When this relation is reduced and H'^22)^{4i) expressed alone 
on the left hand side of the equation we have 

uq uq _ „ uq uq _ 2 rrq rrq , 2 rrq rrq 
-"(22)-"(41) "''-"(32) -"(31) ^ -"(33)-"(21) ^ -"(43)-"(20) 

_ rfiu^ ul _ r, ff"? U'i 

<J -"(44) -"(10) ''-"(33) -"(30) 

On the right hand side of this equation, only H'^^^^H'^^-^s^ does not have the 
property that the concatenated indexing weights are dominant. We apply 
relation (p2[) to this operator: 



-"(32) -"(31) ''-"(33) -"(30) ''-"(42)-"(21) ^ '' -"(43)-"(20) ~ 

„uq uq _ „2 rrq rrq _ 2 rrq rrq , 3 ttQ rrq 
y-"(33)-"(21) y -"(34)-"(20) y -"(43)-"(ll) y -"(44)-"(10) 

Therefore 

uq uq _ f„2 _ \ Tjq rrq , 2 rrq rrq _ 3 zjq rrq 
-"f22)-"f41) yJ-"f33)-"(30) ^ -"r42)-"f21) ^ ^(43)^( 



'(22)-'-'(41) - y^-'-'(33)-'-'(30) ^ -'-'(42)-'-'(21) -'-'(43)-'-'(ll) 

+ il" - + - '?')^(%^(\o) 

We now give the proof of Theorem |^. 

Proof. It is enough to show that if (/x, a) € ih, and (6, v) G Z" then 
If 6 = a + 1 then in the relation (^) the only term that is not indexed 



by weights such that {a, (3) G Z^"^", is H? „)Hf -. and hence it is in 



G>{k,n). 

Otherwise assume that b > a + 1. All of the terms of the equation (^) are 
of the form Hf^ „ , ,„ Hf^ „ , , ,,Hf, ,„ Hf^ , , ...i/f 



q 



or 



'(a,a+|-)"-'(b-|-,/3)' --'(a,a+|-+l)-'-'(6-|--l,/3)' -'^ (a.fe+l-)-'- (a-|2,/3) 

H? , , 1^ ix-ff? la , 1 a\- Let sff?, X be one of these terms after it has 

(«,fe+|^-l) (a-|2+l,/3) (6»,c) ((i,7) 

been rewritten using Corollary ^ so that c) G Z> and (d, 7) G Z" . 

Consider x-ff?. n of the first form since the others follow from essen- 

{e,c) (c(,7) 

tially the same remark. We verify that d — c < b — a (unless Hf^ c^^fi ~ 

11 



Hf . Hf , , and hence by induction the theorem is true since if d — c < 
then (6l,c,d,7) e By definition, 

c= min |a + Ifl, Q!j + (/c — i)| 
d= max {6— I" — 

l<i<n— 1 

We note that 

c > + 1/3' + ~ '^)} ^ ™™ + 1/3) ^ + l} 

and hence c> a with equahty if and only if = 0. Similarly 
d < max {6 — I" z/j — z| < max {6 — I" 6 — 

l<z<n— 1 

and so d <b with equality if and only if |JJ = 0. □ 

The generalization of this statement, that H^^^^-^H^^^) ' ' ' ^j(t) with j^'^'^ £ 

T^^ is in the l\q\ span of the operators iJ^(i)iJ^(2) • • • with a^"^ E 11^' 

and (a^ % dominant weight, is conjectured to be true M], 

but does not seem to follow easily from these relations. 

By setting i = 1 and m = in (20), we immediately obtain another 
relation among the operators which gives us another basis theorem. 

Lemma 13. For all a fi £ Z>, and u S 

(23) i-<if^Hi hi = ^ {-<ir^HiHi 



Proof. From equation (pO|), 

(24) H{U^,v)H{Z'')Q.[-qv*Z] = H{U^)H{v, Z'')n[-qvU*] 

The stated identity is obtained by taking the coefficient of u^v"'z'^ . □ 

Before proving Theorem |9| we give an example. 

Example 14. We wish to write the composition of operators Hj^^^^Hj^^ as 
a linear combination of operators H%H'p with a € and /? G Z^. 

-"(53)-"(2) (54) ^ (1) - -"(5)^(32) {Q)^ [21) 



-"(54)-"(l) (55) ^ (0) ~ -"(5)^(41) ''-"(6)-"(31) 

(55) ^ (0) ~ (5) (50) (40) 

Making repeated substitutions, we have the relation 

_ „2 TTq ttQ j_ ttQ ttQ _ rrq ttQ 
y -"(6)-" (31) -"(5) -"(32) y-"(6)-"(21) 
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We now give the proof of Theorem |^. 

Proof. We prove that if A; > n then G{k,n) C G{k — l,n + 1) as the other 
part is proven in the same manner. It is enough to show that if A; > n, 
a) G and v € then 



We use ( |23| ) with /c — 1 and n. The proof proceeds by induction on fii — a. If 
Hi — a = 0, then there is exactly one term on the left hand side of equation 
(p3|), namely H'^^^^Hy. The right hand side is a Z[g] -linear combination of 

H^H'}, with 7 € Z^^-^ and p G Z"+i. 

If /ii — a > then the left hand side is a linear combination of operators 
of the form Hj^^ c)^Ji with 71 = pi and 

c= min {a + l^fj, Hi + (k - i)] 



> min \ a + K, a + (k — i)\ . 



It follows that c > a with equality if and only if 1/ = p. The right hand side 
of this equation is again an element of Q{k — l,n + 1). □ 

Finally we prove Theorem p!o| . 

Proof. We shall prove Q{k+i, k) C Q{k, k+i) for k,l > 0, the other inclusion 
being similar. Consider ( pO|) with m = and n = k so U = U^, V = V^, 
Z = Z^: 

(25) H{U, V)H{Z)Q.[-qV*Z] = H{U)H{V, Z)n[-qU*V]. 

Take the coefficient of u^v^z'^ in this equation, where (a, /3) G Z^"^^ and 7 G 
Z>. The entire right hand side consists of terms in Q{k,k + £). Expanding 
the expression ^}[—qV*Z] = Y[i^ ~ Q^i/^j), the left hand side is in the set 

where (3' G Z^ such that < (3j + k for all 1 < j < ^ and \(3'\ > \(3\. 
Rewriting a typical term ^, by Corollary ^ one obtains either or up 
to sign H^, say. This means a'^ + (k + i — 1) is the largest part of the 

weight {a, (3') + p^^^^\ Now ai > j3j for all 1 < j < £ by the dominance of 
(a, so 

ai + A; + ^- l>/3j + /c + ^- l>/3j+£-l 

It follows that a'l = ai, (a',/3") G Z^+^ and |a'| + \(3"\ > \a\ + There 
are only finitely many elements of with these properties, so the terms 
H^^, ^irjHy can again be rewritten in the same way, and the process termi- 
nates. □ 
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8. Recovering identities via commutation relations 

The commutation relations in the previous section may be used to recover 
some identities among the operators H^^ that correspond to known identities 
among generaUzed Kostka polynomials. 

Proposition 15. For a € Z and positive integers k and n, 

Proof. In the proof of Theorem IC, take a = (a^), P = (a^), and 7 = (a^). 



The proof shows there is only one term on either side of the identity coming 



from (25), which agrees with (Eq) when n = k + £. □ 



Proposition 16. 

y^') ^(a'=)^((a+l)fc) - y -"({a+l)'=)^{a'=)- 

Proof. When Lemma ^ is applied with fj, = {a'^^^), a, and u = ((a + 1)'^), 
there are no surviving terms on the right and exactly two on the left, indexed 
hy P = u = ((a + l)'^) and /? = (a^). Applying Corollary ^ to the term with 
P = (a'^) the desired identity is obtained. □ 

Proposition 17. For all a ^ Z and k > 1, 

Proof. Apply Lemma |l^ with n = k — 1, jjL = (a^), and v = (a^^^). On the 
left side one has the single nonvanishing term H^^^^-^^^Hl^^f._-^^ corresponding 

to the summand P = v = {a^~^). The right side has two nonvanishing 
terms indexed by a = /x = {a^) and a = /x + (1*^) = ((a + 1)*^). The first 
of these terms is iJ? ... . The second is (—o)'^-?/?, ,-,.,..Hj , u ix. But 

This identity can be viewed as the trace of a short exact sequence that re- 
solves the ideal of a nilpotent conjugacy class closure over the coordinate ring 
of a minimally larger one 0. The version of this identity for the fermionic 
form of generalized Kostka polynomials appears in This (/-character 

identity is put in a more general context in ||5|. 

9. Generalization of Garsia-Procesi defining recurrence for 
Kostka-Foulkes polynomials 

Manipulations of the definition allow us to derive commutation relations 
between the Hi and the operators . As a consequence we obtain a gener- 
alization of a defining recurrence for the Kostka-Foulkes polynomials given 
ini. 

Let E{u) be the generating function of operators on A defined by 
(29) E{u)P[X] = P[X - u]. 
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By we have 

p[x-u] = Y,si{p)[x]s^[-u] = Y,4{pm{-u)\ 

In other words 

(30) eiP[X] = {-!)' P[X-, 

The commutation relation of H{Z^) and E{u) is: 

E{u)H{Z'^)P[X] = E{u)P[X - (1 - q)Z*]VL[XZ]R{Z'') 

= P[X -u-{l- q)Z*]Vt[{X - u)Z]R{Z'') 
= n[-uZ]H{Z'')E{u)P[X] 

Taking the coefficient of {—u)^z^ on both sides of this equation we obtain 
the fohowing relation. 

Proposition 18. Let XeZ"},. Then 

^k^l = X] ^l3^k-\\\+\l3\ 
A//3GV 

Let 77 = (r/i, 772, • • • J ^t) be a fixed sequence of positive integers summing 
to n. For any weight 7 € Z", write 7^"^^ € Z''^ for the first -qi parts of 7, 
^(2) g jri2 £q], ^]^g next r/2 parts of 7, etc. 

Proposition 19. Let k he a fixed positive integer, r] = {'r]i,i]2, ■ ■ ■ ,Tjt) a 
sequence of positive integers summing to n, a & Z", and 7 € Z" such that 

7^*^ G Z^' for all i and \^\ — \a\ = k. Then 



1^1-1^1=^ |A|-|ar=fc 



Proof. Let and 7 be as above. For the moment assume that the entries of 
7 are positive. Apply to (111) and apply Proposition 18 to both sides to 



commute to the right of the H operators: 



Since 7 has positive parts, all the v have nonnegative parts. Expanding the 
left hand side using ( [l6| ) and applying the resulting operators to 1 € A, we 
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obtain 



Assume for the moment that a has nonnegative parts. For such a, Ha 1 = 
Taking the coefficient of Sa[X] on both sides, we obtain the desired 
relation. 

The statement is true in general since -f^A-(a"),7-(a"),»y(9) = -^A,7,r;('?) ^or 
all integers a. □ 

The recurrence for the Kostka-Foulkes polynomials given in 0] is recov- 



ered by setting rj = (1") in Proposition 19, as H^^-^ in our notation is in 



theirs. In the case r/ = (1") the situation is particularly nice; the nondom- 
inant operators can be made dominant using the relation H'^^^H'^^^^^ = 

1-^'{m+i)^{m)' '^^'^ general r} the identities needed to rewrite the nondom- 
inant terms as dominant ones, can get complicated and produce negative 
signs. 



10. Jing's operators 

We give corresponding constructions for Jing's Hall-Littlewood vertex op- 
erators g g Ex. III.5.8]. Define 

B{Z^)P[X] = P[X - Z*]n[XZ{l - q)] 
B{Z'')P[X] = P[X - z*]n[xz{i - q)\R{Z^) 
Bl = B{Z^) 

for V ^ T]^ . The generating series of operators Bi^z) (for a single vari- 
able z) and B{Z^) defined here, coincide with the operators B{z) and 
B{zi, Z2, . . . , Zk) in the notation of Ex. III. 5. 8]. B{z) in our notation 
is the operator H{z) in Jing's However the operators B^, themselves are 
not studied by Jing or Macdonald. 

Let F be the plethystic operator FP[X] = P[X{1 — q)], with inverse 
operator F~^P[X] = P[X/{1 — q)]. Then it is not hard to show that 

(31) B{Z'') = FoH{Z'')oF-\ 
This gives the following analogue of ( p!6|) for B{Z^). 

(32) i3;,,i3;,,...i?;,)= Kx,,Al)Bl. 

AeZ" 
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